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q ■ Abstract 

The Watts-Strogatz algorithm of transferring the square lattice to a small world 
network is modified by introducing preferential rewiring constrained by connec- 
tivity demand. The evolution of the network is two-step: sequential preferential 
\Q ■ rewiring of edges controlled by p and updating the information about changes 

done. The evolving system self-organizes into stationary states. The topological 
. transition in the graph structure is noticed with respect to p. Leafy phase - a 

graph formed by multiple connected vertices (graph skeleton) with plenty of leaves 
attached to each skeleton vertex emerges when p is small enough to pretend asyn- 
chronous evolution. Tangling phase where edges of a graph circulate frequently 
among low degree vertices occurs when p is large. There exist conditions at which 
the resulting stationary network ensemble provides networks which degree distri- 
bution exhibit power-law decay in large interval of degrees. 
PACS: 02.50.Ey, 89.75.Fb, 89.20.Ff 
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■ 1 Introduction 

H , 

From communication networks like World Wide Web or phone networks, 
through nets of social relations, namely networks of acquaintances or col- 
laborating scientists, to biological systems where protein networks, neural 
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networks or cell metabolisms are considered — all of them manifests a sim- 
ilar structural organization: small-world properties (short distances , strong 
clustering) and the power- law vertex degree distribution. See, e.g., [111211111 El 
for review of data analysis and bibliography. Most of these natural and man- 
made networks change in time. Although these networks undergo different 
restructuring processes, their crucial statistical properties are time indepen- 
dent. The networks are self-organized to stationary states. Any stationary 
state can be realized by many (usually huge) number of microscopically differ- 
ent configurations. Evolution of a stationary state denotes that microscopic 
changes performed do not influence the global characteristics. 

In the present paper we propose a stochastic microscopic dynamic rule 
which leads a regular lattice into the stationary network state. By simulations 
we show the relation between the details of microscopic rule and the distribu- 
tion of the vertex degree in a stationary state. Our proposition is based the 
Watts-Strogatz construction of the small-world network by rewiring edges 
0- 

Here, we do not consider any dynamics on a network. However, our 
studies are motivated by models of large spatially extended systems with 
short-range interactions, like Ising models, in which a spin is attached to 
each vertex |H1 El UH1 EEU U2] • Such networks can model the magnetic 
nanomaterials. Electronic components are represented as vertices and the 
wires are edges [T3]. The neural networks may also be considered as kind of 
electronic circuits following the idea of 'save wiring' as an organizing 

principle of the brain [To] . 

Our research is aimed on giving hints about the matter in which changes 
are performed on two levels. The first level means that the network topology 
evolves. The second level denotes that spins located in nodes are adjusted 
according to the new network structure. Preliminary study of such materials 
can be found in [T71 [TBI dj • Stochastically evolving connections between at 
average constant number of vertices can also be viewed as the playground for 
modeling community structures in networks [211] or coauthorship networks 

The studies of the network topology began with the random graph theory 
of Erdos and Renyi [22] • The proposition of Watts and Strogatz [5| that 
followed, called small world network, captures the features of regular lattice 
and random graph. The algorithm may be summarized as follows: begin with 
a regular lattice, then rewire an edge with some probability P. Traditionally, 
the evolution in the Watts-Strogatz network is measured by P. Let us divide 
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the process of rewiring of P -part of edges into t substeps such that P = t*p. 
Hence, we can say that the p- part of edges is rewired synchronously at each 
time step. If rewiring is stochastic, like in the Watts-Strogatz algorithm, 
then the resulting network after t steps with p-part edges rewired each time 
step is equivalent to a network obtained after one step with P = t * p - 
part edges rewired. However, if rewiring goes preferentially and information 
about modifications introduced is updated once in a time step then different 
networks can be observed. 

We show, by simulation, that under some conditions the resulting net- 
works are different from networks obtained in the 1-step evolution with the 
corresponding P. In particular, it appears that if rewiring is accompanied 
with 'synchronized' preference then the self-organization of the network state 
occurs. Namely, the stable vertex degree distribution is reached though the 
evolution of edges continuous. It is said that the ensemble of graphs emerges 
and the evolution walks on graphs belonging to this ensemble [23]. 

Moreover, we present arguments that the topological transition between 
the graph ensembles takes place. If p values are small then, so-called, leafy 
phase emerges. The phase ensemble consists of graphs formed by multiple 
inter connected vertices, called graph skeleton, with plenty of leaves attached 
to each skeleton vertex. Occurrence of connections between vertices of similar 
properties such as, e.g., similar degrees, is termed assortativity and the high 
probability of connections between vertices with different degrees is termed 
disassortativity (221 • The strong assortativity between hubs present in the 
stationary state results from preferences in dynamics considered. Moreover, 
the vertices of the graph skeleton are surrounded by leaves, namely each hub 
belongs to a star-like subgraph. Hence together with strong assortativity of 
hubs the strong disassortativity is present also. On the other hand, if p is 
large enough then the network stabilizes in, so-called, tangling phase where 
edges of a graph circulate frequently among low degree vertices. 

All network ensembles are characterized by the distinct degree distri- 
butions with exponentially vanishing tails. However, when the parameters 
driving the network evolution are specially adjusted, then the power-law de- 
cay appears in the rather wide interval of vertex degrees. The exponent 7 for 
this decay is close to 2 what suggests strong inhomogeneity in the network. 

The algorithm is presented in Section 2. Section 3 contains results ob- 
tained by simulations. The discussion and development of the model is pro- 
posed in Section 4. 



3 



preference functions 
T=8 



probability 

to unlink: 




degree 



Figure 1: The preferences in case T = 
Pui(T) = p always, (color on line). 

2 Algorithm 



8. Notice, that = and 



Let us number vertices of the lattice as 1, 2, . . . , N. Then each edge is char- 
acterized by the two numbers (from, to) representing two vertices linked by 
this edge. The graph is represented as the vector of size N of lists of vertices 
- neighbors of subsequent vertices. The graph is not considered as directed, 
though the algorithm can easily be adapted to a directed one. 

There are two basic parameters in the model: p — probability to rewire 
an edge each time step, and T — threshold in the preference function. 

The synchronized preferential rewiring step means: 

1. Choose at random any of N nodes. For the node % chosen the set of its 
edges {(«, ji)} is reviewed. The following decisions are made: 

(i) the subset {ji*} C {ji} of edges to rewire is selected with probability 
p u i calculated as follows, see Fig. [TJ 

if deg( J ,) = l 

PM) ri*frs*fcj) if deg(^)>l 

(ii) for each jV selected to rewire the new attachment is assigned /^with 
probability to link to /j*-node pi given by 
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Figure 2: An edge linking vertices from and to (left graph) is rewired to 
the edge between vertices from and new Jo (right graph) (color on line) 



pi{k*) = mm(l, — - — ) 

2. The global information on the vertex degrees is updated. 

Since there are possible differences in applying Watts-Strogatz idea of 
rewiring, below we give the evolution procedure. The basic procedure, called, 
EdgeEvolution, requires three parameters: from, p and T. The illustration 
of the networks before (left graph) and after( right graph) rewiring is shown 
in Fig. El 

EdgeEvolution ( from, p, T) : 

(a) for each vertex to from the list of edges of the vertex 
from do 

(b) if deg(to) > 1 then 

(c) choose £i £ [0, 1] at random and 

(d) if £i < d0 g^ o ) then accept the vertex to 
for unlinking 

(e) for each vertex to accepted for unlinking 

(f) choose new Jo £ {1,2,..., iV} at random but 
new Jo 7^ from 

(g) choose ( 2 £ [0, 1] at random and 
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(h) if £ 2 < de s( n ™- t °) then accept new Jo, i.e., 

edge(from,to) := edge(from,newJo) 

(i) otherwise go to (f) 
Remarks: 

- The algorithm conserves both the number of vertices and the number 
of edges. Steps (a)-(d) prepare the list of edges of the vertex from to be 
rewired, while steps (f)-(i) fix new connections. Each edge accepted for 
rewiring must be rewired (see the loop(i)). 

- The condition (b) is introduced to avoid presence of zero-degree ver- 
tices. Any vertex with a degree equal to 1 cannot be unlinked. Otherwise 
we face the problem of dramatically increasing number of isolated nodes. 
However, this condition does not protect a graph from being disconnected. 

- A randomly selected new vertex for linking to must be different from 
the from vertex to avoid loops in a graph, line (f), however, multiple edge 
links are not forbidden. 

- Since information regarding the vertex degree is updated after each 
time step, hence if the network is evolving with small p, then the evolution 
may be seen as asynchronous. 

- If deg(to) = T then the probability to unlink from the to vertex is 
equal to p while if deg(to) < T (deg(to) > T) then probability to unlink 
is greater (smaller, respectively) than p. Therefore, the rewiring goes with 
some effective probability p e ff- The mean values of p e ff are shown in Fig. El 
One should notice that the number of edges rewired each time step is time 
independent. 

3 Results 

3.1 Reaching stationarity 

We test by simulations the algorithm described in the previous section applied 
to a square lattice with L = 100 for different p and with preferences governed 
by the following two T values T = 8 and T = 16. It effects that number 
of vertices considered is N = 10 4 and the constant number of edges is 2N. 
Since each edge is represented double - on both lists of vertices associated to 
the edge, the total number of edges considered in rewiring process is AN. 
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P 

Figure 3: Normalized averages of numbers of rewired edges (with standard 
deviation errors) each time step for different p and T = 8, 16, (color on line). 

If preferences are not switched on then the network quickly reaches the 
stationary state with the Poisson degree distribution centered at k = 4 [T7| . 
If the preferences are switched on then for any p and T in a few time steps 
the initial 5 degree distribution centered at k = 4 transforms into some other 
distribution. Our focus is on the process of graph restructuring. In the 
series of figures: Figs IU El El we present arguments to prove the fact that a 
graph evolving at any p reaches a state for which further edge changes do 
not influence on the vertex degree distribution. Then we say that the system 
is self-organized into the fixed stationary state. 

In Figs |U and El typical evolutions of vertex degree distributions are pre- 
sented. The horizontal axis describes vertex degree in log-scale. The vertical 
axis is for time steps. To quantify properties of the evolving graph, in Fig. 
El we characterize the state of the self-organization by the second moment of 
the distributions. The statistical physics of graphs says that graphs with a 
fixed number of edges compose the canonical ensemble ^21 123 121] and the 
second moment (or equivalently the sum of degrees squared of all vertices) 
can be interpreted as the energy carried by a graph with fixed number of 
edges, |23 123 • 

The obtained results show that changes in a graph evolving with p = 
0.0001 are similar to those found for corresponding first steps of a graph 
evolving with p = 0.001. The passing time cannot be distinguished from 
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. L=100.p=0.0001.T=8 




L=100,p=0.001,T=8 



i 




L=10a p=0.01,T=S 




vertex degree 



Figure 4: Self-organization in the graph structure studied by the distributions 
of vertex degree in time, case T = 8, log-scale (color on line). Notice, that 
the graph evolution presented in the top figure can be found as the first 
50 000 steps of the evolution shown in the middle figure, and the evolution 
presented in the middle figure can be seen as the first 50 000 steps of the 
bottom figure. 
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L=100, p=Q.Q1,T=1B 




vertex degree 

Figure 5: Self-organization of the graph structure studied by the distributions 
of vertex degree in time, case T = 16, log-scale (color on line). Notice, 
that the graph evolution presented in the top figure can be found as the 
first 100 000 steps of the evolution presented in the middle figure, and the 
evolution presented in the middle figure can be considered as the first 100 000 
steps of the bottom figure. 
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the value of p. Comparing figures with p = 0.001 to figures with p = 0.01 
the similar observation holds. Therefore the first simulation proved fact 
is that p * 4N rewirings in each time step after t time steps is equivalent 
to the change made by rewiring p * t * 4N edges in one time step for p 
sufficiently low. In particular, the evolution with the preference threshold 
T = 8 goes in this asynchronous way for all p < 0.01 and the stationary 
state of the asynchronous evolution is reached within the observed 500 000. 
If T = 16 then the stabilization of a system needs more time. Therefore 
all our observations are of 10 6 time steps long. Nevertheless to reach the 
asynchronous dynamics ensemble in case of p = 0.01 we let the system evolve 
ten times longer, so that we can state again that for all p < 0.01 the same 
stationary state is observable, see legends to Fig. EJ 

With increasing p, namely p > 0.2, stationary states are reached defi- 
nitely faster for both T values. Here the 'synchronized' preferential rewiring 
dominates in one-step transition what results that at each p the system con- 
stitutes different stationary ensemble. These ensembles are distinct quan- 
titatively from each other by the different vertex degree distributions what 
reflects in the distinct values of k 2 . 
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3.2 Stationary state vertex distribution 

In Figs 171 l%l 191 and fTUl we show distributions of the stationary states obtained 
at different p and for T = 8 and T = 16, respectively. 

In Fig. UJ the top panel describes the graph ensemble resulting from 
asynchronous evolution. The degree distribution is like a two-part function. 
The first part represents properties of vertices which are not preferred, i.e., 
vertices with its degree smaller than the threshold (k < 8). The second 
part of the distribution represents the tail properties, i.e., probabilities to 
find vertices with degrees much greater than the threshold T = 8, k >> T. 
The tail decays exponentially with the rate a = 0.016(0.99) (the Pearson 
r 2 -error is added in brackets). Between these two separated regions there is 
a transient region, here the transient region means 8 < k < 40, which can be 
described by the power-law dependence on vertex degree. The exponent for 
this decay is 7 = 0.43(0.97). Notice, that this transient region is not visible 
on the exponential curve. 

With rewiring rate p increasing, the exponential tail decay slows down 
(at p e (0.3,0.4), a = 0.0068(0.99) and this is the minimal value observed 
by us) and then grows up to a = 0.017(0.95) at p = 0.7, see the second 
and third panels in Figd Together with fast tail decay, the transient region 
with power-law characteristics links to the first part of the distribution what 
forms the largest vertex degree interval with power-law type of distribution. 
At p = 0.8 we have the exponent of the power-law decay 7 = 1.95(0.97) for 
2 < k < 70, see Fig. |H]top panel. However, for k > 70 the decay changes into 
7 = 6.6(0.96). Finally, when p > 1 then the transient region vanishes. The 
decay corresponding to vertices with k < 8 can be still approximated by a 
power-law but then if k > 8 the fast exponential decay occurs. In particular 
at p = 1.5 we have exponential rate decay a = 0.215(0.99) and power law 
decay with exponent 7 = 0.86(0.96) when k < 8, see Fig. |H] bottom panel. 

In case T = 16 the first and tail parts of degree distribution are isolated 
from each other for a large interval of p, see the first and second panels in 
FigEl The noticeable transient region constitutes at p — 0.6 (7^0 for 
20 < k < 360 ), see FigJUJthe bottom panel. With growing p, similarly to 
the ensembles resulting from evolution with T = 8, we observe the junction 
between the first and transient regions of the distribution, and the largest 
interval of the power-law decay establishes. Namely, when p = 0.9 then 
for 2 < k < 80 7 = 2.22(0.99), see the top panel in FigUHl However for 
vertices with a degree k > 80 we observe the fast exponential-like decay. 
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Figure 7: The stationary vertex degree distributions in case T = 8 and at 
different role of synchronous dynamics: the asynchronous dynamics results 
(top figure) and stationary distributions resulting from different synchronous 
evolution rule. The two horizontal scales are used to amplify properties. The 
ordinary linear scale (bottom) is to observe exponential dependences and the 
log scale (black plots) is to show the power-law degree regions of decay (gray 
plots), (color on line). 
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Figure 8: The stationary vertex degree distribution in case T = 8 and p 
when the largest interval of vertex degrees is of a power-law type (upper 
figure, the gray plot) and the stationary distribution of a vertex degree in 
case of the most synchronous dynamics (bottom figure). The two horizontal 
scales are used to amplify properties. The ordinary linear scale (bottom) is 
to observe exponential dependences and the log scale (black plots) is to show 
the power- law degree regions of decay (gray plots), (color on line). 

Stationary ensembles arising from the evolution with p > 1 are similar to 
those described in case T = 8. The first part, which can be approximated by 
power-law, spreads to k — 16. Then the fast exponential decay occurs, see 
FigHH 

3.3 Phase transition 

From the vertex degree distribution study it appears that at fixed T there 
exist two different self-organized graph ensembles corresponding to the small 
p and large p value. It is said that if some global statistical property represen- 
tative for a graph topology changes then such a phenomenon is referred to as 
topological phase transition [22] • As the most appropriate order parameters 
to describe this transition we consider k 2 — mean energy in the ensemble, 
and k max — the largest vertex degree which occur with probability greater 
than 10~ 5 . Fig. ITTIshow dependences of both order parameters on p e ff- For 
both T values and both order parameters two regions of p e ff are observed. 
The point of topological phase transition can be localized as pfjj G (0.2, 0.3) 

The two phases in graph topology can be described as follows: 
Leafy phase: 
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Figure 9: The stationary vertex degree distributions in case T = 16 at differ- 
ent role of synchronous dynamics: the asynchronous dynamics results (top 
figure) and stationary distributions resulting from different synchronous evo- 
lution rule. The two horizontal scales are used to amplify properties. The 
ordinary linear scale (bottom) is to observe exponential dependences and the 
log scale (black plots) is to show the power-law degree regions of decay (gray 
plots), (color on line). 
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Figure 10: The stationary vertex degree distribution in case T = 16 and 
p when the largest interval of vertex degrees is of a power-law type (upper 
figure, the gray plot) and the stationary distribution of a vertex degree in 
case of the most synchronous dynamics (bottom figure). The two horizontal 
scales are used to amplify properties. The ordinary linear scale (bottom) is 
to observe exponential dependences and the log scale (black plots) is to show 
the power-law degree regions of decay (gray plots), (color on line). 



There is a huge component consisting of almost all vertices and few little 
2, 3- vertices graphs. Small number of vertices with extremely high degrees 
(hubs) serve as centers of this component. These centers are multiple inter- 
connected between each other what together establishes a firm long living 
graph skeleton. The skeleton is close to the complete graph. Hence the 
strong assortativity between hubs is present. Since the vertices of the graph 
skeleton are surrounded by plenty of leaves then one can find the strong dis- 
assortativity between skeleton vertices and leaves. At low p about 90% of 
vertices are leaves and therefore we call a typical network of the ensemble as 
leafy-complete graph and the corresponding phase as leafy phase. 
Tangling phase: 

At p > 1 the strong expectation can arise that the network ensemble should 
collapse to a stochastic graph. This expectation is supported by the fact that 
when p > 1 then there exists a degree interval, namely T < k < pT where 
the probability to unlink and probability to link to are equal to 1 - like in a 
stochastic graph. Moreover, vertices with k > pT are still of high probability 
to be unlinked, see FigJT] The stochastic graph distribution is distinguished 
from others by the peaked shape around the average degree value, here sharp 
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Figure 11: The second moment of the vertex degree distributions (with 
standard deviation errors) and maximal vertex degree (probability that such 
a vertex occur on a lattice is greater than 0.1) in the stationary regime, (color 
on line). 



maximum at k = 4 should appear. However, such distribution did not appear 
at any model parameters considered by us. The dynamics which persistently 
applies the preference rule, drives the system to other than a stochastic graph 
solution. There is not a typical vertex for network. Instead vertices k < T 
occur with similar probability. One can think that each time step plenty 
of edges are moved around between the similar low degree vertices what 
blocks the possibility to establish vertices with higher degrees. Let us call 
this network ensemble as tangling net to underline activity and inefficiency 
of the evolution rule. The corresponding phase will be called tangling phase. 

The process of transition from the leafy to tangling phase can be explained 
qualitatively in the following way. In leafy phase there is a pool of edges at- 
tached to vertices of little degree and a small number of vertices with high 
degrees which are densely interconnected between each other. The presence 
of multiple connections makes the skeleton connections degenerated what re- 
sults in that the effective number of edges in the system is much smaller than 
2N. With growing p the information about changes in the edge connections 
are not immediately available to other rewirings what weakens the assorta- 
tivity between hubs. Therefore the graph skeleton obtains less possibility to 
emerge and the mechanism analogous to the preferential attachment in grow- 
ing models of scale free networks can occur. 'New' edges appear due to 
vanishing connection degeneracy. Though the appearance of the graph skele- 
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ton is less probable, but centers which accumulate edges occur due to the 
persistently applied dynamics with preferences. 

4 Conclusions and discussion 

By considering the network evolution as two-step: the preferential rewiring 
of edges and updating of the information about changes done we obtain a 
discrete time network evolution. In this time step scale the evolution drives 
a regular lattice to the graph ensemble with fixed statistical properties. The 
presented simulation foundings can be summarized as follows: 

1. Networks evolving with preferential rewiring rule self-organize into sta- 
tionary states. 

2. The stationary states form ensembles of exponential-type networks. 

3. The statistical properties of the stationary states such as vertex degree 
distribution, its second moment and maximal vertex degree are related 
to model parameters p and T. 

4. In the space of stationary states two separated regions are identified: 

- the limit of asynchronous preferential evolution, called leafy phase, 
if p< 0.01 and T = 8, 16 

- the limit of synchronous higly rewired preferential evolution, called 
tangling phase, if p > 1.0 and T = 8, 16 

Between these two phases for different model parameters the different 
final states occur. 

5. The maxima of the second moment of vertex degree distribution and the 
largest vertex degree are localized at p m 0.2 for both T. This feature 
suggests that the transition point between the two phases observed can 
be related to this value. 

6. The transition goes by smashing multi-connections between vertices 
belonging to the graph skeleton. Since the wide interval with the power- 
law decay in the degree distribution is observed we can claim that the 
mechanizm which is characteristic for Barabasi- Albert network, namely 
the growth in the network [21)], is present. But here this mechanizm 
denotes the increase in the number of effective egdes. 
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The two most important physical mechanisms are usually listed to explain 
the occurrence of power-laws [U]. (1) a rich-get-richer mechanism in which 
the most linked vertices get more links. Here such mechanizm is represented 
by the preferential attachment rule and moreover this mechanizm introduces 
a kind of ordering. (2) critical phenomena where the ordering mechanizm is in 
conflict with some dissordering process. Here, a temperature like mechanizm 
can be ralated to the synchronization. The synchronization weakens the 
order coused by the preferential rule. This confict effects in appearence of 
critical properties. 

Rough investigations about the graph ensembles arisen when T = 100 
have been done but only for p > 0.1 to limit the length of runs. Again, 
the limit stationary degree distributions can be divided into two classes: the 
leafy-complete graph ( p — 0.1 ) and the exponential graph (p — 1.0). How- 
ever, for any value of p, there was not noticed a power-law dependence in 
the first part of the distribution as well as there was not observed any tran- 
sient region. Hence, in the phase-space of T parameter another topological 
transition can be localized. 
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